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ABSTRACT 

The use of magnitude estimation scaling (MES) was 
investigated to clarify ed^ucationa,! priorities and to ascertain the 
commonality of desijred e ducational' outcomes in> three Washington 
communities. One item from a set of 50 outcome statements was 
selected as the referent, and participants in- several' communities 
compared the remaining items to ^t, assigning a value to each item in 
terms of its relative. 'importance. The field test supported the 
feasibility of MES for clarifying prioril^^^. A wid^ range of 
geometric means and a clear ranking of items were obtained fot 
fiecisio/- making purposes. The ordering of objective areas 
demonstrated commonality a;iQOfi.g the communities surveyed apd with 
pthe^ studies. (Author) / ^ ' ' 
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Tnis study had two" purposes • In- general, it attempted t'o investigate 
the feasibility of using a magnitude estimation scaLi^ng (MES) procedure to 
clarify educational priorities ±ti stnatl school districts, Specifically,* 
however, the MES ' responses of participants in three Washingt^pti bommunities 
were compared to determine the ^commonality of desired/ educational outctoies 
and the predictive value of the items. iThe study was conducted by the 
Program Evaluation and Research -Section of the Washington Superintendent 
of Public Instruction with the assistance of Ediicatfonal Service District 
llA. . , . ' - * 
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Magnitude estimation scaling is defined as a process' whi 
each participant's determination of item values fpr the 
used fixed category scales. Instead of ' indicatfy(g item 
terms, of one of a set-o^ categories, for exampleV one of 
participant is requested to assign values to each ^^-<he s 
relation to a selected referent poiitt. In many 
item has been given a value of 50, and- participants in 
compare each of the remaining items to this. If an it 
be twice as important as the referent it is rated ^lOO , f 
important 250, lialf import^t 25, The geometric mean 
measure of central tendencJy and as the basis for statist 
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The activities , reaper ted in this paper build on three previous efforts: 
a pilot study conducted at the Stanford Research Institute (Dell and 
Meeland, 1973) which compared . the resf>onses of a group using a fixed 
category ^cale to those of a group using MES; a MES .assessment of needs 
for a Calitornia elementary school (hfonta Loma, 1974) ; and an investigation 
using MES in small Washington school districts %o determine the desirability 
of selected educ'ational outcomes (Rasp, 1975), The survey items used in 
the^e studies were nearly identical . Mth most adapted from a collection 
of outcome statements developed by the Center for the Study of Evaluation 
at the University* of California, Los Angeles, . * ' 
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In the present investigation fifty survey items were jJrepared as sets , 
of cl^rds. Foliowtiig the common lead phrase, "Upon completion of 
eiementaty' school (6th*gfa^> -it is desirable that as.' a result of 'school / 
mos/t children...'* each card contained a. statement of an outcome defined 
-by example's. One l£em from the survey was selected randomly and assigned 
the value of .50. Participants were--instructed to compare the rejiaining^ 
items to this referent ^^&x^ -^o'^s^^slga values iti terms of relative importance. 
lisj:ing of <the -it^enis in abridged form is included on page four. 

Three school districts located in rural/ suburbaa areas along the northerjn 
coast of the Olympic Peninsula in Washington participated in the study. 
The districts ranged ,in size from approximately 130 to 1,650 students. 
After the MES process and materials were- reviewed in a joint meetlttg, 
local advisory Committees were 'formed with respolisibilit y : for coordi- 
nating the district-wide efforts, for selecting the participant population, 
for distributing and colleeting the survey cards, and for reporting informa- 
tion to their^ coinmunities. The coirtpleted survey^ packets were sent^ to the 
state affice for tabulation. At that time' the responses were key 
'punched for computer processing and the geometric mean for each^" item 
was calculated. The results of^ the survey were analyzed, arranged 
for public display, and returned to the local districts. The geometric 
means ^^are- included on page four.* 

The respons^es for the survey items in the three districts approached 
congruence. When the items were ordered based on the magnitude of the 
geometric me^ns, all three districts shared ten common items or 83 percent 
in -t-he upper quartile and twelve common items or 92 percent in the lower 
quartil^. In addition, since the survey items represent eleven areas 
of , elementary educational objectives, the arithmetic means of the geometric 
means for the items subsumed by each objective were calculated. The 
plotting of these jfteans resulted in a nearly identical rank ordering 
display. In comparing the tbrtee Washington communities with the 
experience of the^ Honta Loma/ School in California,' the rank ^order 
pattern was again^^ reinforce^ . This data is presented on ^page five. 
Tu study the statistical sigfiTlYcance of the differences in the rankings 
by the .Washington communities, a Friedman two-way analysis of variance 
by ranks was conducted oh the ordering of the geometric means for each 
item. With two degrees of freedom, the Friedman value of .21 indicated 
that ih^ priorities established independently by 'the three communities 
v?ere not significantly different and that differences a^ great as those 
observed could be~ expected 90% of the time based on chance alone. 

The results of the community priority surveys, as in other studies, 

speak well to the practicability of the items ^nd process. The local 

advisory committees testified to the ease of logistical operations.. 

The participants were clearly able to "e^imate magijitude. *\ /fha composite 

of responses did generate a wide range of geoir.etric means and a qlear 

rai|k ordering^of items. The informati^^ was reported as being useful 

f or dec ision-making purposes. ' ' ^ . 
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^ MAGNITUDE ESTIMATION SCALING ITEMS 

IN ABRIDGED FORiM WITH GEOMETRIC MEANS 

l^pon Lonjplt'bioa uf eienK'ntaFy school (6th grade) it is desirabLe that as a result of 
sclaooi most children: 

^, ' ' Crescent Fairy lew Sequim 

•I. Know and practice health and safety.... 50 50 ...... 50 

/1\ - Have a positive attitude toward school ^nd teachers 116 173 105 

^. Sh'>w a desire to achieve * 133 173 124 

^. Have an appreciation' for reading 255 229 141 

~). Know about economics '. ^ 72"^ 61 57 

0. Like arts and crafts ^ 38 A3 43 

7. Know about physical education 74 98 63 

8. Perform some form of music arts 60 78 57 

9. Make art and craft objects 54 56 49 

10. Know about political science 125 79 

11. Have developed interests outside of school 78 89 99 

12. Have developed a sense of sportsmanship 173 144 I43 

I). Have a general positive attitude toward themselves 254 213 187 

Have {^eaithy social qj|titudes ; . . . . 227 173 172 ► 

13. Know a foreign language 36 24 30 

16. Have begun to understa;id philosophies 68 56 5? 

Know about religions 73 ...... 48 49 

1-;. Know about anthropology 38 40 39 

19. Know about sociology.^ , 1. 59 47 56 

20. Know facts about history ; 86 99 68 

21. Know something about foreign languages » 47 40 42 

22. Know about drugs ' ' 121 .117 99 

2 3. Know about psychology , 61 43 59 

!4. Have developed good study skills *. 212 222 163 

2'5. Have a heaichy personal temperament ^ ..166 144 153 

26. Know the basic ideas of mathemat ics.^ 240 180 136 

27.. * Know how tq do basjx^jrrt^thmetie' problems 307 *.302 216 

2.8. Kno\; liow to reacf 397 342 242 

2^. Be .iblr to use mathematics 356 ^ 264 178 

30. Can iiuer^ret what they read ^ 345 283 202 

3i: Can luuiorstand what tl\ey read 383 300 209 

32. Kncu h«>w t.) write well 323 » 257 194 

5j. Spc<ik ^o that others can understand them...* .'...I 253 202 ...'..183 

3*^^. Kn^^w something about the physical sciences ♦ . . ♦ . .|. . ^ 96 81 IX 

3'3. Ik able to listen - .......1.276 2A2 189 

iO. Know and use language correctly ■ . . | . • . I .^2 32 ....i. 222' 155? 

J 7. Know aboMl geoi!;Va[ihy » i . . . ^ . . . - . 1^46 13^ 

...,..;.136 139. 

.. .1.'. .144 154 

Kr^)W inan\ facts or ideas^^ I. ..1. 87 127 80 

(,<ui break down infarmation l.l. ..■ 108 138 83 

kJ. Have an undcrslatuling of what they le.irnud -..157.. 178 141 

» ' ic apiOv what tliey have learned L67 1 77 165 

fl.ivr a neural ide.i of the use of hisiof^y 82 93 

► '). Khv^w - onu'Lhing <i'bouL biolo^^.v 88 8^ ' 8J 

Know about ecology 96 68 103 

V^njoy and appreci<iU^ music 81 59 79 

48. Understand arts and (rafts 5') 53 58 

^f9. Know somc'thin^ abcnit the earth scit-aces 104 110 84 

•OO. Have sonif kuowled^^o ol t am i 1 v life educat ion 90 ()4 
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lU^ <r^lc t.o make judgments % 136 139 148 

J'i. tan put information together., s I L'. .144 154 131 
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